Eigenvalue bounds, spectral partitioning, 
and metrical deformations via flows 



Punyashloka Biswal* James R. Lee* Satish Rao* 

66"' 
O 1 

' Abstract 

We present a new method for upper bounding the second eigenvalue of the Laplacian of 
bJQ. graphs. Our approach uses multi-commodity flows to deform the geometry of the graph; we 

embed the resulting metric into Euclidean space to recover a bound on the Rayleigh quotient. 
, Using this, we show that every n-vertex graph of genus g and maximum degree d satisfies 

\ A 2 (G) = Q( (g+^) d y This recovers the O(^) bound of Spielman and Teng for planar graphs, 

and compares to Reiner's bound of 0( (g+1) P° ly(d) ), but our proof does not make use of conformal 
^yy . mappings or circle packings. We are thus able to extend this to resolve positively a conjecture 

^"^ \ of Spielman and Teng, by proving that A 2 (G) — 0( dh l ° sh ) whenever G is if^-minor free. This 

shows, in particular, that spectral partitioning can be used to recover 0(y / n)-sized separators in 
q | bounded degree graphs that exclude a fixed minor. We extend this further by obtaining nearly 

optimal bounds on A 2 for graphs which exclude small-depth minors in the sense of Plotkin, Rao, 
! and Smith. Consequently, we show that spectral algorithms find small separators in a general 

■ class of geometric graphs. 

Moreover, while the standard "sweep" algorithm applied to the second eigenvector may fail 
to find good quotient cuts in graphs of unbounded degree, our approach produces a vector that 
. works for arbitrary graphs. This yields an alternate proof of the result of Alon, Seymour, and 

Thomas that every excluded-minor family of graphs has 0(^/n)-node balanced separators. 

o : 

q ; 1 Introduction 

. ! Spectral methods are some of the most successful heuristics for graph partitioning and its variants. 

They have seen a great deal of success in application domains such as mapping finite element cal- 
culations onto parallel machines [46, 50], solving sparse linear systems [40], partitioning for domain 
decomposition [11, 12], VLSI circuit design and simulation [10, 22, 4], and image segmentation [45]. 
We refer to [47] for a discussion of their history and experimental success. 

Recent papers [47, 21, 25] have begun a theoretical analysis of spectral partitioning for families 
of graphs on which it seems to work well in practice. Such analyses proceed by showing that 
the second eigenvalue of the Laplacian of the associated graph is small; from this, one derives a 
guarantee on the performance of simple spectral algorithms. The previous approaches of Spielman 
and Teng [47] and Kelner [25] either work for graphs which already possess a natural geometric 
representation (e.g. simplicial graphs or k- nearest-neighbor graphs), or use conformal mappings (or 
their discrete analog, circle packings) to impart a natural geometric representation to the graph. 
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Unfortunately, the use of these powerful tools makes it difficult to extend their analysis to more 
general families of graphs. We present a new method for upper bounding the second eigenvalue of 
the Laplacian of graphs. As evidence of its efficacy, we resolve a conjecture of Spielman and Teng 
about the second eigenvalue for excluded-minor families of graphs. Furthermore, we show that 
the "spectral approach" can be useful for understanding the cut structure of graphs, even when 
spectral partitioning itself may fail to find those cuts; this occurs mainly in the setting of graphs 
with arbitrary degrees, and yields a new proof of the separator theorem of Alon, Seymour, and 
Thomas [3]. 

1.1 Previous results and our work 

Let G = (V, E) be an n- vertex graph with maximum degree d. Spielman and Teng [47] show that if 
G is a planar graph, then A2 = 0(d/n), where A2 is the second eigenvalue of the Laplacian of G (see 
Section 1.2.1 for background on eigenvalues and spectral partitioning). It follows that a very simple 
spectral "sweep" algorithm finds a quotient cut of ratio 0(d/y/n) in such graphs. For d = 0(1), 
this shows that spectral methods can recover the cuts guaranteed by the planar separator theorem 
of Lipton and Tarjan [31]; in particular, recursive bisection yields a balanced separator which cuts 
only 0{^/n) edges. The proof of Spielman and Teng is based on the Koebe-Andreev-Thurston circle 
packing theorem for planar graphs, which provides an initial geometric representation of the graph. 
Indeed, in his survey [33], Lovasz notes that there is no known method for proving the eigenvalue 
bound without circle packings. 

In [25], Kelner proves that if G is a graph of genus g, then A2 = 0(^-)poly(<f). Again for 
d = 0(1), this shows that spectral algorithms yield balanced separators of size 0(y/ (g + l)n), 
matching the bound of Gilbert, Hutchinson, and Tarjan [19]. Kelner's proof is not based on circle 
packings for genus g graphs, but instead on the uniformization theorem — the fact that every genus 
g surface admits a certain kind of conformal mapping onto the unit sphere. (It turns out that the 
discrete theory is not as strong in the case of genus g circle packings.) Kelner must embed his 
graph on a surface, and then recursively subdivide the graph (keeping careful track of A2), until it 
approximates the surface well enough. 

Excluded-minor graphs. The preceding techniques are highly specialized to graphs that can 
be endowed with some conformal structure, and thus Spielman and Teng asked [47] whether there 
is a more combinatorial approach to bounding A2. In particular, they conjectured a significant 
generalization of the preceding results: If G excludes Kh (the complete graph on h vertices) as a 
minor, then one should have A2 = 0( poly ^ d ). See Section 1.2.2 for a brief discussion of graph 
minors. 

Our new methods for bounding A2 are able to resolve this conjecture; in particular, we prove that 
A 2 = 0( fe6(lo n gfe)d ). As a special case, this provides eigenvalue bounds in the planar and bounded 
genus cases which bypass the need for circle packings or conformal mappings. As stated previously, 
these bounds show that for d,h = O(l), spectral algorithms are able to recover the 0( v / n)-sized 
balanced separators of Alon, Seymour, and Thomas [3] in i^-minor-free graphs. 

Geometric graphs. Spielman and Teng also bound A2 for geometric graphs, e.g. well-shaped 
meshes and /c-nearest-neighbor graphs in a fixed number of dimensions. Although these graphs do 
not exclude a .K^-minor for any h (indeed, even the n x n x 2 grid contains arbitrarily large 
minors as n — > 00), these graphs do exclude minors at small depth, in the sense of Plotkin, Rao, 
and Smith [38]. (Essentially, the connected components witnessing the minor must be of bounded 
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diameter; see Section 1.2.2.) Spielman and Teng [47] ask whether one can prove spectral bounds 
for such graphs. 

In Section 5.3, we prove nearly-optimal bounds on A2 for graphs which exclude small-depth 
minors. This shows that spectral algorithms can find small balanced separators for a large family 
of low-dimensional geometric graphs. 

Graphs with unbounded degrees. Finally, we consider separators in arbitrary graphs, i.e. 
without imposing a bound on the maximum degree. Very small separators can still exist in such 
graphs, if we consider node separators instead of the edge variety. For example, Alon, Seymour, 
and Thomas [3] (following [31, 19]) show that every ^-minor-free graph has a subset of nodes of 
size of 0(/i 3 / 2 y / n) whose removal breaks the graph into pieces of size at most n/3. 

The Laplacian of a graph is very sensitive to the maximum degree, and thus one does not expect 
spectral partitioning to do as well in this setting. Nevertheless, we show that the "spectral ideology" 
can still be used to obtain separators in general. We show that if one runs the "sweep" algorithm, 
not on the second eigenvector of the Laplacian, but on the vector we produce to bound the Rayleigh 
quotient, then one recovers small separators regardless of the degree. In particular, our approach is 
able to locate balanced node separators of size 0(h 3 \/log hy/n) in K^-minor-free graphs; this gives 
a new proof of the Alon-Seymour-Thomas result (with a slightly worse dependence on h). 

Overview of our approach. At a high level (discussed in more detail in Section 1.3), our approach 
to bounding A2 proceeds as follows. Given a graph G, we compute an all-pairs multicommodity 
flow in G which minimizes the £2- norm of the congestion at the vertices. This flow at optimality is 
used to deform the geometry of G by weighting the vertices according to their congestion. We then 
embed the resulting vertex-weighted shortest path metric into the line to recover a bound on the 
Rayleigh quotient, and hence on A2. The remaining technical step is to get control on the structure 
of an optimal flow in the various graph families that we care about. 

We remark that our bounds are optimal, except for the slack that comes from the embedding 
step. E.g., for genus g graphs we actually achieve the bound A2 = O(^) (minjlog n, g}) 2 , where we 
expect that the latter factor can be removed. For instance, our approach might give a path toward 
improving the Alon-Seymour-Thomas separator result to its optimal dependency on h. 

1.2 Preliminaries 

Given two expressions E and E' (possibly depending on a number of parameters), we write E = 
O(E') to mean that E < CE' for some constant C > which is independent of the parameters. 
Similarly, E = Q(E') implies that E > CE' for some C > 0. We also write E < E' as a synonym 
for E = O(E'). Finally, we write E ~ E' to denote the conjunction of E < E' and E > E' . 

All graphs in the paper are assumed to be undirected. K n denotes the complete graph on n 
vertices, and K m>n denotes the complete m x n bipartite graph. For a graph G, we use V(G) and 
E(G) to denote the vertex and edge sets of G, respectively. 

1.2.1 Eigenvalues and spectral partitioning 

Let G = (V,E) be a connected graph with n = \V\. The adjacency matrix A G of G is an n x n 
matrix with (A G )ij = 1 if (i,j) £ E and (A G )ij = otherwise. The degree matrix of G is defined 
by (Dg)h = deg(i) for all i € V, and (Dc)i j = for % ^ j. Finally, we define the Laplacian of G 
by 

L G = D G - Aq. 
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It is easy to see that Lq is a real, symmetric, positive semi-definite; if we order the eigenvalues of Lq 
as Ai < A2 < • • • < A n , and let v±, V2, ■ ■ ■ , v n be a corresponding orthonormal basis of eigenvectors, 
one checks that Ai = and v\ = ^(1 5 1) • • • , !)■ A vast array of work in spectral graph theory 
relates the eigenvalues of Lq to the combinatorial properties of G (see, e.g. [14]). In the present 
work, we will be most interested in the connections between the second eigenvalue A2, and the 
existence of small quotient cuts in G, following [13, 2]. We will write A2(G) for A2 when G is not 
clear from context. 

Given a subset S C V, we define the ratio of the cut (S, S) by 

\E(S, S)\ 

9G[b) min(|5|,|S|)' {L) 

where E(S, S) is the set of edges with exactly one endpoint in S. We also define <!>* (G) = 
minscv ^g(S). Finally, we say that S C V is a 5-separator if minds'!, > <5n. 

Spectral partitioning uses the second eigenvector of G to attempt to find a cut with small ratio. 
The most basic spectral partitioning algorithm uses the following simple "sweep." 

1. Compute the second eigenvector z 6 M. n of Lq. 

2. Order the vertices V = {1,2, ... ,n} so that z\ < Z2 < ■ ■ ■ < z n and output the cut of the 
form {1, ...,«}, {i + 1, n} which has the smallest ratio. 

The next result is well-known and follows from the proof of the Alon-Milman-Cheeger inequality 
for graphs [13, 2]; see, e.g. [47, 34]. 

Theorem 1.1. For any v G W 1 with Y17=i v i = ®> the sweep algorithm returns a cut S C V with 



where d max is the maximum degree in G. 

Furthermore, one can use recursive quotient cuts to find small <5-separators in G [31]. 

Lemma 1.2. Let G = (V,E), and suppose that for any subgraph H of G, we can find a cut of 
ratio at most (j). Then a simple recursive quotient cut algorithm returns a ^-separator S C V with 
\E(S,S)\<0(4>n). 



1.2.2 Graph minors 

If H and G are two graphs, one says that H is a minor of G if H can be obtained from G 
by a sequence of zero or more of the three operations: edge deletion, vertex deletion, and edge 
contraction. G is said to be H -minor- free if it H is not a minor of G. We refer to [32, 15] for a 
more extensive discussion of the vast graph minor theory. 

Equivalently, H is a minor of G if there exists a collection of disjoint sets {A>}t>gy(#) with 
A v C V(G) for each v G V(H), such that each A v is connected in G, and there is an edge between 
A u and A v whenever (u,v) £ E(H). 

Following [38] , we see that H is a minor of G at depth L if, additionally, there exists such a 
collection of sets with diam(A„) < L for each v £ V(H), where diam(A„) = maxjjg^ dist(i,j) and 
dist is the shortest-path distance in G. 
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1.3 Outline 



We now explain an outline of the paper, as well as a sketch of our approach. Let G = (V, E) be a 
connected, undirected graph with n = \V\. Using the variational characterization of the eigenvalues 
of Lq (see (8)), we can write 



A 2 (G) . £ ut , gg |/(i/)-/fo)| 2 ^ . Z uveE d(u,v) 
mm — , - , ; --—777 > mm 



2n f-.v^R E u ,vev l/H " f( v )\ 2 d:VxV^R+ Eu,veV d ( u , t') 2 ' 

where the latter minimum is over all semi-metrics on V, i.e. all symmetric distance functions that 
satisfy the triangle inequality and d(u, u) = for u £ V. 

Of course we are trying to prove upper bounds on A2(G), but it is not difficult to see that by 
Bourgain's theorem [7] on the embeddability of finite metric spaces in Hilbert space, the second 
minimization is within an O(logn) 2 factor of the first. In Section 4, we discuss more refined notions 
of "average distortion" embeddings which are able to avoid the O(logn) 2 loss for many families of 
graphs; in particular, we use the structure theorem of [26] to achieve an O(l) loss for excluded-minor 
families. 

Thus we now focus on finding a semi-metric d for which 

is small. It is easy to see that for any graph G, the minimum will be achieved by a shortest-path 
metric, and thus finding such a d corresponds to deforming the geometry of G by shrinking and 
expanding its edges. In actuality, it is far more convenient to work with deformations that involve 
vertex weights, but we use edge weights here to keep the presentation simple. Thus in the body of 
the paper, all the edge notions expressed below are replaced by their vertex counterparts. 

Unfortunately, mindlZoid) is not a convex optimization problem, so we replace it by the con- 
vexified objective function 

C G {d) ~ ^<KEd{u,V? 



T, u ,vev d ( u > v ) 

In the proof of Theorem 5.1, we connect IZoid) and Co(d) via Cauchy-Schwarz; the structure of 
the extremal metrics ensure that we do not lose too much in this step. 

In Section 2, we show that minimizing Cc{d) is a convex optimization problem, and thus we are 
able to pass to a dual formulation, which is to send an all-pairs multicommodity flow in G, while 
minimizing the £2 norm of the congestion of the edges. In fact, examination of the Lagrangian 
multipliers in the proof of Theorem 2.2 reveals that the optimal metric d is obtained by weighting 
an edge proportional to its congestion in an optimal flow. Thus, by strong duality, in order to prove 
an upper bound on (2) for some graph G, it suffices to show that every all-pairs multicommodity 
flow in G incurs a lot of congestion in the £2 sense. 

We address this in Section 3. First, we randomly round a fractional flow to an integral flow, 
with only a mild blowup in the ^-congestion. In the case of planar (and bounded genus) graphs, 
we observe that an all-pairs integral flow in G induces a drawing of the complete graph in the 
plane. By relating the ^-congestion of the flow to the number of crossings in this drawing, and 
using known results on graph drawings, we are able to conclude that ^-congestion must be large, 
finishing our quest for upper bounds on the eigenvalues in such graphs (the entire argument is 
brought together in Section 5). 
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Extending this to ii-minor-free graphs is more difficult, since there is no natural notion of 
"drawing" to work with. Instead, we introduce a generalized "intersection number" for flows with 
arbitrary demand graphs, and use this in place of the crossing number in the planar case. The 
intersection number is more delicate topologically, but after establishing its properties, we are able 
to adapt the crossing number proofs to establishing lower bounds on the intersection number, and 
hence on the ^-congestion of any all-pairs flow in an excluded-minor graph. We end Section 3 
by extending our congestion lower bounds to graphs which exclude small-depth minors. This is 
important for the applications to geometric graphs in Section 5.3. 

Balanced vertex separators with no d max dependence. In the argument described above for 
bounding \2(G), we lose a factor of d max . It turns out that if we simply want to find a small vertex 
separator in G, then we can use the vertex variant of the minimizer of (2) to obtain a metric on G, 
along with an appropriate embedding of the metric into M from Section 4. By passing these two 
components to the vertex-quotient cut rounding algorithm of [17], we are able to recover vertex 
separators in arbitrary graphs, with no degree constraints. This is carried out in Section 5.2. 

1.4 Related work 

The Riemannian setting. Bounding the eigenvalues of the Laplace-Beltrami operator on Rie- 
mannian manifolds and, in particular, surfaces, has a long and rich history in geometric analysis; 
see [43]. In particular, Hersch [24] showed that for any Riemannian metric on the 2-sphere, one has 
\2{M) < Q( vo i( M ) )) where vol(M) denotes the Riemannian volume of M. The approach of Hersch 
has many parallels to that of Spielman and Teng, and one can compare his bound to the 0(l/n) 
bound for n-node bounded-degree planar graphs. 

Furthermore, Yang and Yau [51] show that for a compact surface M of genus g, the bound 
A2(M) < O( ^jpjf) ) holds. Of course, this is similar to Kelner's bound of 0(^-) for n-node graphs 
of genus g; both proofs are based on conformal uniformization, but Kelner's proof is more involved. 
Indeed, the graph case is somewhat more difficult since there are an infinite number of different 
topologies, while for compact surfaces of genus g, there is only one. 

Finally, Korevaar [27], answering a question of Yau, gives bounds on the higher eigenvalues of 
genus g surfaces, of the form Afc(M) < O( ^w^ ). Grigor'yan and Yau [20] discuss some extensions 
of Korevaar's approach to bounding eigenvalues of the Laplacian on graphs, but their techniques 
require the existence of a very strong volume measure on the graph, e.g. in order to obtain our 
bounds for a d-regular graph, they would require that for every vertex x and R > 1, \B(x,R)\ = 
0(R 2 ), where B(x,R) is the i?-ball about x. We certainly cannot make such an assumption; in 
fact, the difficult case for us is when the initial graph has very small diameter. 

Connections with discrete conformal mappings. One can view the minimizer of (2) (or, more 
appropriately, the maximizer of the vertex version (3)) as a sort of global "uniformizing" metric for 
general graphs. In the setting of discrete conformal mappings, a number of variationally defined 
objects appear, and duality is often an important component in their analysis. We mention, for 
instance, the extremal length [16] as a prominent example. It also often happens that one chooses a 
weight function w : V — > R+ as the minimizer of some convex functional, and this weight function 
plays the role of a discrete Riemannian metric (much as is the case in Section 2); see, e.g. the work 
of Schramm [44] and He and Schramm [23]. 

A significant difference between these works and ours is that the flow which is dual to the 
weight function involves a single commodity, i.e. generally one node is trying to send flow to one 
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other node. Our work is based on the more global use of multi- commodity flows, where the duality 
relationship is more complex (and, in particular, a corresponding max-flow/min-cut theorem no 
longer holds). 



2 Metrics, flows, and congestion 

Let G = (V, E) be an undirected graph, and for every pair u,v £ V, let V uv be the set of all paths 
between u and v in G. Let V = \J uv< =y'Puv A flow in G is a mapping F : V — > R+. We define, 
for every vertex v £ V, the value 

C F (v)= Yl F (p) 

p£P:v£p 

as the vertex congestion of F at v. For p > 1, we define the vertex p- congestion of F by 

i/p 



con p (F)=(j2C F (v)A . 

\i>ev / 



We say that F is an integral flow if, for every u,v £ V , \{p £ V uv : F(p) > 0}| < 1. Given 
a demand graph H = (U,D), we say that F is a unit H-flow if there exists an injective mapping 
g : U — ► F such that for all (i, j) £ D, we have Yl nC -n F(p) = 1, and furthermore F(p) = if 
P ^ U(j j)gd ^g{i)g{j) m ^ n i- n t e 9 ra l H-flow is a unit ff-flow which is also integral. 

Lemma 2.1. For any #rap/i G = (V, E 1 ) and demand graph H = (U,D), and any unit H-flow F 
in G, there exists an integral H-flow F* such that 

con 2 (F*) < con 2 (F) + ^con^F) < con 2 (F) + \V\ 3/2 . 

Proof. For a flow F:V^ M+ and vertices x,u,v, let F uv {x) = ^2 x ^ p ^p uv F(p). Define the random 
flow F* as follows: For each demand pair uv, independently pick one path p £ V uv with probability 
F(p). Set F*(p) = 1 for each of the selected paths, and zero for all other paths. Then 



E[con 2 (F*) 2 ]=E[£(£ iC(x)) 1 



x£V u.vEV 



= E ( E E i F uv( x ) 2 ] + 2 E np: v (x)} ek v wi) • 

x&V u,veV {u,v}^{u' ,v'}CV 

Observing that F* v (x) £ {0, 1}, 

E[con 2 (F*) 2 ] < E E nK v (x)] + E( E WKvi*)]) 2 < coni(F) + con 2 (F) 2 . 

x£V u,v£V x&V «,ti£V 



By concavity, we conclude that E[con(F*)] < y/coni(F) +con 2 (F); in particular, there exists some 
fixed flow F* that achieves this bound. □ 
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A non-negative vertex weighting s : V — > R+ induces a semi-metric d s : ^ x ^ ^ ^+ defined 
by d s (u,v) = mm peVuv ^2 xep s(x). We define 

A,( G ) . %|^#. (3) 

The main theorem of this section follows. 
Theorem 2.2 (Duality of metrics and flows). Let G = (V, E) be any graph with n = \V\, then 

mincor^-F) = max A S (G), 

F s:V — >]R_|_ 

where the minimum is over all unit K n - flows in G, and the maximum is over all non-negative 
weight functions on V. 

Proof. Let P £ {0, iy VxV be the path incidence matrix and Q £ {0, \} Vx d) be the path endpoint 
matrix, respectively, which are defined by 

P =[ l Q =[ l peVuv 

) otherwise ' 1 otherwise. 

Then we write max s: \/^R + A S (G) as a convex program (P) in standard form, with variables (d, s) £ 

n = x R\. 

minimize — ^ d 

subject to Qd ^ Ps \\s\\% < 1 (P) 
s h d h 

Next, we introduce the Lagrangian multipliers / € and /J, £ R + and write the Lagrangian 
function 

L(d, s, f, fj) = -l T d + f T (Qd - Ps) + fi(s T s - 1) 
= d T (Q T f - 1) + (fis T s - fPs) - M . 

Therefore, the Lagrange dual g(f, fi) = inf/ d s ) 6 n L(d, s, /, ji) is given by 

<K/,/x) = mi [d T (Q T f - 1) + inf (^ S T S - / T P S ) - ii. 

The dual program is then supf 4l g(f,fi). In order to write it in a more tractable form, first observe 
that g(f,fi) = -co when Q T / -< 1- But if we require that Q T / y 1, it is easy to see that the 
optimum must be attained when equality holds. To minimize the quadratic part, set V(^s T s — 
f 1 Ps) = to get s = P T f /2fi. With these substitutions, the dual objective simplifies to 

^ — ^ 

To maximize this quantity, set /i* = \\P T f\\ 2 /2, and get g(f,n) = —\\P T f\\2- Therefore, the final 
dual program is 

min ||P T /|| 2 
subject to fy_0 Q 1 / = 1 



( p *) 
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When P and Q correspond to a K n demand graph for G, the dual optimum is precisely minj cori2(/), 
where the minimum is over unit K n -tiows. 

The theorem now follows from Slater's condition in convex optimization; see [8, Ch. 5]. 

Fact 2.3 (Slater's condition for strong duality). When the feasible region for (P) has non-empty 
interior, the values of (P) and (P*) are equal. 

□ 

3 2-congestion lower bounds 

In the present section, we prove lower bounds on the 2-congestion needed to route all-pairs multi- 
commodity flows in various families of graphs. 

Theorem 3.1 (Bounded genus). There exists a universal constant c > such that if G = (V,E) is 

2 

a genus g graph with n = \V\, and F is any unit K n -flow in G, then cori2(-F) > ^= for n > 3yfg. 
Proof. By Lemma 2.1 it suffices to prove the theorem when F is an integral flow. Suppose, for the 

2 

sake of contradiction, there exists an integral i^ n -flow F with cori2(-F) < 

The drawing of G in a genus g surface S induces (via F) a drawing of K n in § where edges of 
K n only cross at (the images of) vertices of G. Clearly the number of crossings is upper bounded 
by J2veV Cf(v) 2 = con2(F) 2 < On the other hand, it is known that as long as n > 3^/g, 

any drawing of K n in a surface of genus g requires at least ^ edge crossings [1, 30], yielding a 
contradiction. □ 

Now we prove a similar theorem for i^-minor-free graphs. To this end, suppose we have a 
graph G = (V, E) and an integral flow 92 in G. For every G E(H), let ipij be the corresponding 
flow path in G. Define 

inter(^) = #{(», j), (»',/) G E(H) : = 4 and Vij n <p Vj , + 0}. 

Lemma 3.2. // tp is an integral H-flow in G = (V, E) with inter^) = and H is bipartite with 
minimum degree 2, then G contains an H-minor. 

Proof. Let V(H) = L U R be a partition for which E(H) C L x R. Let 93 be an integral .ff-flow in 
G with inter^) = 0. We may assume that V(H) C V. For a vertex i G V(H), let N H (i) C V H be 
the set of j G R with (i,j) G E(H). For each i G V(iJ), let Vi = Uj e N H (i) fij- 

Now, for each i G L and j G Nn(i), consider the path ip^ = (v\, V2, ■ ■ ■ , Vk), and let vt be 
the first vertex in this path for which vt G U r eL\{«} Vr- If no such t exists, define (pij = ip^, and 
otherwise define the prefix (p^ = {v\,V2, ■ ■ ■ , vt-i}. Set Cj = Uj G Ar H (j) to be the union of all 
such prefixes. Then, for each i G R, define Gi = Vi \ UjgL 

We claim that the sets {Ci}i^LYjR are all connected, and pairwise disjoint, and that for (i,j) G 
E(H), we have E(Ci, Cj) 7^ 0. This will imply that G has an i^-minor. We start with the following 
straightforward fact. 

Fact 3.3. IfveV r n V r < for some r / r' G L, then v £ UjeL Cj- 
Lemma 3.4. For every i G L U R, we have i G Cj. 
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Proof. First, we consider i £ L. If i ^ Cj, then i occurs as an intermediate vertex of some <p rs path 
for r £ L,s £ R with r ^ i. Since i has degree at least 2 in If, there must exist some s' £ R with 
s ^ s' and (z, s') G E(H). But now i G yv s PI ipi s i which contradicts the fact that inter(y)) = 0. 
Thus we must have % G Cj. 

To see that i G Cj for i £ R, note that by assumption degj^ (i) > 2, so there must exist r ^ r' G L 
for which (r, i), (r',i) G Thus i £ V r DV r r, and by Fact 3.3, it must be that i g \J jeL Cj. We 

conclude that i € Cj. □ 

Connected and disjoint components. Lemma 3.4 implies that i G Cj for i £ L, so it is clear by 
construction that the sets {Cj}j £ L are each connected and that for any i £ L and j £ L U R \ {i}, 
we have Cj n Cj = 0. Thus we need only verify that each set Cj is connected for i £ R, and also 
that for i,j £ R with i / j, we have Cj n Cj = 0. 

Lemma 3.5. If i £ R and j £ Nh(i), then ipji \ ifji C Cj. 

Proof. Any node v £ ifji \ (pji must be contained either in Cj or in C r for some r £ L with r ^ j. 
But the latter case cannot occur because any node which is contained in Vj Pi V r for r ^ j cannot 
be contained in C r by Fact 3.3. □ 

Using the fact that i G Cj (Lemma 3.4) and the preceding lemma, we see that Cj is connected 
for every i £ R. It remains to show that for i,j £ R with i ^ j, we have Cj PI Cj = 0. 

Suppose, to the contrary, that Cj PI Cj / 0. Since inter(<£>) = 0, there must exist a k £ L such 
that (ifki n Cj) n (ipkj H Cj) / 0. The following lemma shows this to be impossible. 

Lemma 3.6. For k £ L and i,j £ Nn(k), we must have ifki Pi (fkj Q Ck- 

Proof. Suppose, to the contrary, that there is a v £ <pk% Pi ipkj f° r which v ^ Ck- In this case, it 
must be that v £ V r for some r £ L with r / k. In other words, for some s £ R, (p rs intersects 
both ifki and (fkj, but this is impossible since i 7^ j and inter (</?) = 0. □ 

Edges of E(H). Consider i £ L and j £ R with £ E(H). It is straightforward to see that 
Vij Q Cj by construction, and on the other hand, ipij \ (pij C Cj, by Lemma 3.5. Since i £ C L and 
j G Cj by Lemma 3.4, it follows that E(Ci, Cj) / 0. This complete the proof. □ 

Corollary 3.7. For every h > 2, if G is K^-minor-free, and ip is an integral K 2 h-flow in G, then 
inter(</?) > 0. 

Proof. If ip is an integral K 2 h how with inter (ip) = 0, the obviously it induces an integral K^h flow 
with the same property. By Lemma 3.2, C has K^ ^ as a minor, and hence also has as a minor, 
yielding a contradiction. □ 

Lemma 3.8. For any integral flow (p in G, we have 00112(9?) > y / inter(^). 

Proof. Clearly, 



inter(c^) < 

vev 



i,j,i',j'eE{H) 



£ 1 



veifij 



1 



■veipiiji 



□ 



We begin with an elementary proof that yields a suboptimal bound dependence on h. 
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Theorem 3.9. If G = (V, E) is Kh-minor-free and n = \V\, then any unit K n -flow F in G has 
con 2 (F) > forn> Ah. 

Proof. Using Lemma 2.1, it suffices to prove the theorem when F is an integral fT^-flow in G. By 
Lemma 3.8, it suffices to show that inter (F) > ygp-- 

If (p is any integral flow with inter (tp) > 0, then one can always remove a terminal of p to 
obtain an integral flow if/ for which inter(ip') < inter(<£>) — 1. From Lemma 3.2, we know that for 
an integral K 2 h-now ip, we have inter(ip) > 0. It follows that if <p is an integral i^ r -flow in G, then 
inter(y?) >r-2h + l. 

Now let p £ [0, 1], and consider choosing a random subset S p C V by including every vertex 
independently with probability p. Let n p = \S p \, and let F p be the integral i^-flow formed 
by restricting the terminals of F to lie in S p . It is obvious that E[n p ] = pn and E[inter(F p )] = 
p 4 ■ inter (F), since all intersections counted by inter (F) involve four distinct vertices. Hence, 

p 4 ■ inter(F) = E[inter(F p )] > E[n p - h + 1] > pn - 2h. (4) 

We may assume that n > 4h, and in this case choosing p = ^ in (4) yields 

finishing the proof. □ 

To do better, we first require the following theorem proved independently by Kostochka [28] 
and Thomason [49]. 

Theorem 3.10. There exists a constant ck > 1 such that for every h G N, every graph H with 
\E{H)\ > ckt\V (H)\h\/log h contains Kh as a minor. 

We remark that the preceding theorem is tight [28, 18, 6]. We now proceed to an improved 
bound. 

Theorem 3.11 (Excluded minors). There exists a universal constant c > such that if G = 

2 

(V, E) is Kh-minor-free and n = \V\, then any unit K n -flow F in G has cor^i 7 ) > h ™ h for 
n > AcKrh^log h + 1, where ckt is the constant from Theorem 3.10. 

Proof. As in the proof Theorem 3.9, it suffices to prove that inter(F) = ^( h -2^ gh ) whenever F is 
an integral -fT n -flow in G. 

If p is an integral H-t\om with inter(^) > 0, then obviously there exists an edge e 6 E{H) and 
an integral {H \ e)-flow (p' for which inter(<//) < inter((/j) — 1. Combining this with Theorem 3.10 
and Lemma 3.2 shows that for any H-now (p in G, we have 

inter^) > \E(H)\ - 2c KT \V(H)\hy / Io~gh, 

where ckt is the constant from Theorem 3.10. 

We now apply this to the i^ n -flow F. As in the proof of Theorem 3.9, let p G [0, 1], and consider 
choosing a random subset S p C V by including every vertex independently with probability p. Let 
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n p = \S P \, and let F p be the integral K np -Qow formed by restricting the terminals of F to lie in S p . 
We have, 

p 4 • inter (F) = E[inter(F p )] > p 2 "^ ~ ^ - 2c KT pnh^\ogh (5) 

We may assume that n > icxrhy/log h + 1, and in this case choosing p = 4cK ^ fe ^ log — in (5) 
yields 

, n(n — l) 3 

inter (F) > - ; , „ / , , 
v > ~ Uc 2 KT h 2 log h 

finishing the proof. □ 

Bounds for shallow excluded minors. Finally, we prove congestion lower bounds for graphs 
which exclude minors at small depth. This is useful for applications to geometric graphs in Section 
5.3. 

Theorem 3.12. There exists a constant c > such that if'G = (V, E) excludes a K^-minor at depth 
L and n = \V\, then any unit K n -flow in G has cori2(-F) > cmin ^ ^== , n 3//2 L^ for n > ch\f\og h. 

Proof. Suppose that G excludes a i^-minor at depth L, and let F be an integral K n flow in G. 
First, we state the following straightforward strengthening of Lemma 3.2. 

Lemma 3.13. If ip is an H-flow in G in which every flow path has length at most L/2, then G 
contains a depth-L H-minor. 

Now, if at least half of the " ( -" 2 ~ 1 ^ flow paths in F have length greater than L/2, then the total 
length of flow paths is at least J7(n 2 )L, which shows that 



con 2 (F) = C f( v ) 2 ^ n ~ 1/2 Yj Cf ^ = n ( n3/2 ) L - 

y vev vev 

If, on the other hand, at least half of the flow paths in F have length less than L/2, let F 1 be the 
flow restricted to such paths. Clearly F' is an integral inflow for some dense graph H on n nodes, 
hence the proof of Theorem 3.11 (with Lemma 3.13 substituted for Lemma 3.2) shows that for n 

large enough, we have cori2(-F) > cor^-F') = 0, ( hjfog h ) ' ^ 

Corollary 3.14. There exists a constant c > such that the following holds. Suppose that for 
some d > 1 and every L > 1, G = (V,E) excludes a K L d minor at depth L. If n = \V\, then 
con 2 (F)>cn 3 / 2 (^) 1/(M+2) . 



4 Average distortion embeddings and random partitions 

In this section, we use a construction of Rabinovich to embed certain metrics into the line with 
small "average distortion." This allows us to pass from a good metric on a graph to a good bound 
on the Rayleigh quotient. Our main technique is the use of random padded partitions, a now 
standard tool in the construction of metric embeddings (see, e.g. [5, 42, 41, 29]). 
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4.1 Random partitions 

Let (X, d) be a finite metric space. We recall the standard definitions for padded decompositions 
(see, e.g. [29]). If P is a partition of X, we will also consider it as a function P : X — > 2 X such 
that for iGl, P (x) is the unique C £ P for which x £ C. 

Let /U be a distribution over partitions of X, and let P be a random partition distributed 
according to fi. We say that P is A-bounded if it always holds that for S G P, diam(S') < A. 

Given a A-bounded random partition P, we say that P is a-padded if for every x £ X, we have 

Pr[P(x,A/a) C P(x)} > i, 

where B(x,r) = {y : d(x,y) < r} denotes the closed ball of radius r about x. 
We recall that the modulus of padded decompos ability is the value 

a(X, d) = sup \ a : X admits a A-bounded a-padded random partition > . 

A>o > 

Now we can state a consequence [42] of the main theorem of Klein, Plotkin, and Rao [26]. 

Theorem 4.1. Let G = (V,E) be any graph which excludes K r as a minor, let len : E — > R + be 
an assignment of non-negative lengths to the edges of G, and let da be the associated shortest-path 
semi-metric on G. Then a(V,da) = 0(r 2 ). 

Corollary 4.2. If G = (V, E) excludes K r as a minor, and s : V — > M + is a non-negative weight 
function on vertices, then the induced semi-metric d s satisfies a(V,d s ) = 0(r 2 ). 

Proof. Simply define \en(u,v) = s(u) + s(v) for (u,v) £ E. Clearly the shortest-path distances 
induced by len and s are within a factor of 2, so the result follows from Theorem 4.1. □ 

We also have the following theorem of Bartal for general metrics [5] (see [29] for a proof of the 
precise statement, based on [9]). 

Theorem 4.3. For any finite metric space (X,d), we have a(X,d) = 0(log|X|). 

4.2 Average distortion embeddings 

Rabinovich [41] essentially proved the following theorem in the case p = 1. For applications to 
eigenvalues, the case p = 2 is of particular interest (see Section 5.1). For direct application to 
vertex separators (Section 5.2), we will employ the p = 1 case. For a metric space (X,d), a 
mapping / : X — > R is said to be non-expansive if \f(x) — f{y)\ < d(x, y) for all x,y £ X. 

Theorem 4.4. For every p > 1, there exists a constant C p > 1 such that for any metric space 
(X,d), there exists a non-expansive mapping f : X — > R with 

d(u,vr<C p [a(X,d)] p \f(u)-f{vW. 

Proof. We prove the theorem for p = 2. The other cases are similar. Let A 2 = Y^u vex v ) 2 - 
First, we handle the case when many points are clustered about a single node xo £ X. In what 
follows, we use B(x, R) = {y £ X : d(x, y) < R} to denote the closed ball of radius R about x £ X. 
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Case I: There exists xq € X for which \B(xq, |A 2 )| > yg. 

In this case, let S = B(x , |A 2 ), and define f(u) = d(u, S). First, we have 

n 2 A 2 = d {u,v) 2 < 2 E [d(u,x ) 2 + d(v,x ) 2 ] 

u,v£X u,v 

= An d(u, xq) 2 
uex 

2 

< An E 

uex L 



< ^ 2 +8nY,d(u,Sf 



2 »fe.V 



Therefore, J2 u ex d(u, S) 2 > ^j^ 1 - We conclude that 



E (f(u)-f(v)) 2 = £ [d(u,S)-d(v,S)} 2 

u,veX u,v£X 

> Yl [d(u,S)-d(v,S)f 

u(£S,veS 

= E d ^ s ) 2 

u<£S,v£S 

= \S\Yd(u,S) 2 



> n 2 A 2 



u&X 

2 
2 



> E 



This finishes the clustered case. 

Case II: For every u £ X, \B(u, \A 2 )\ < jq. 

In particular, we know that for any subset TCI with diam(T) < ^A 2 , we have |T| < n/10. 

Now, let P be a random partition of X which is |A 2 bounded and a-padded, where a = a(X, d). 
We know that for every i £ I, we have 

Pr[B(x,A 2 /(4a))CP(x)] > X -. 

So by Markov's inequality, it must be that there exists a partition Pq such that the set 

H = {x e X : B(x, A 2 /(4a)) C P(x)} 

has \Hq\ > n/2. Fix this choice of Pq and i?o- 

Let {ucjcePo be a collection of i.i.d. uniform 0/1 random variables, one for each cluster C £ Pq 
and define S = \JceP :a c =o ^ ■ Finally, define / : X — > E by /(it) = (i(n, S 1 ). 
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Note that / is a random function. We will now argue that 

2 



E 



> 



u,vex 



(6) 



which will imply (by averaging) that there exists a choice of / : X 
least ft(a- 2 ) E u ,, e x <*( 



for which the sum is at 



So it remains to prove (6). Note that for every C G Pq, we have diam(C) < A2/4, so since we 
are in case (II), we have |C| < n/10. Write 

(/(«) - /w) 2 = E s ) - d M 5 )) 2 

^ E E £(d(u,S) -<*(«, S)) 2 . (7) 

So let's estimate E [(d(it, «S) — <i(v,S')) 2 ] for tx € C n -ffo and v ^ C. Since u, i> lie in different 
clusters, conditioned on what happens for v, we have d(u, S) oscillating randomly between when 
ac = and some value greater than A2/(4a) when uc = 1 (since u € i?o)- It follows that 
E^Sj-df^)) 2 ]^. 

Plugging this into (7) and using \C\ < n/10 for every C G Pq yields 



E 



£ (/(«) - /(t;)) s 



> E E 

ceP u&cnHo 

> ^ 9n _ A 2 , 



A 2 
^2 

64a 2 



c*eP «eCnH 
9n A 2 . 



10 64a 2 



= |#o| 

> 



10 64a 2 

A \ 2 

nA 2 



a 



finishing our proof of (6). 



□ 



5 Spectral bounds and balanced separators 

We now combine the tools of the previous sections to prove bounds on the Rayleigh quotients of 
various graphs. 

5.1 Eigenvalues in bounded degree graphs 

Let G = (V,E) be any graph, and set n = \V\. Letting \2{G) be the second eigenvalue of the 
Laplacian of G, by the variational characterization of eigenvalues, we have 



£ wgg i/w-/fr)i 2 _ 2n . E uv eE\m-m\ 2 

Euev\fW-f\ 2 !/(«)- /Ml 2 ' 



A 2 (G) = min m ^^±L^L i^ll = 2 n • min^ ^ UV&E L^Z J -^> . (8) 
where /= £ £ xeV /(a:). 
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Theorem 5.1. Let G = (V, E) be any graph with maximum degree d max , let s : V — > M+ be a 
non-negative weight function on vertices, and let d s be the induced semi-metric. Then, 

. (n , < d max n 3 [a{V,d s )} 2 
A2(G) ~ A^Gp • 

Proof. If <i is any metric on V, then using (8) and Theorem 4.4, we have 

HG)<n.[a(V,d)f ^ Ed };>% . 



Therefore, 



< 



n[a(V,d s )] : 



|2 



V 



u, v 



< n[a(V,d s ) }- 



^ A A 3r (it -7 M2 S^gy 5 ^) 2 

< 4ef max n [a(V,d s )J 



4d max n 3 [a(F,4)]' 



A S (G)2 ' (9) 
where the penultimate inequality follows from Cauchy-Schwarz. □ 

Theorem 5.2. If G = (V 7 , E) is a genus g graph with n = \V\, then X 2 (G) = O(^f^). 

Proof. For any weight function s : V — ► R + , we have a(V, d s ) = 0(g) by Corollary 4.2, hence (9) 
yields 

0(d max5 r 2 n 3 ) 



A 2 (G) < 



,4 , 



max s: y_ >IR+ A S (G) 2 ' 

But by Theorems 2.2 and 3.1, we have max s: y_,.R + A S (G) 2 = ramp con 2 (F) 2 > ^(^), where the 
minimum is over all i^ n -flows in G. □ 

Theorem 5.3. If G = (V,E) is K h -minor-free and n = \V\, then A 2 (G) = o( dmax ^ log/t ). 

Proof. For any weight function s : V — > R+, we have a(V, d s ) = 0(h 2 ) by Corollary 4.2, hence (9) 
yields 

0(d max /i 4 n 3 ) 



A 2 (G) < 



max s: v_ K+ A S (G) 2 ' 



But by Theorems 2.2 and 3.11, we have max s; ^t + A S (G) = min^ con 2 (i ? ) > D( fe2 " ogfe ); where 
the minimum is over all X n -flows F in G. □ 



\2\ d n 



Remark 5.1. Using Theorem 4.3, one can give the bounds A 2 (G) = O ([maxjlog n, g} 
and A 2 (G) = O ([max{log n, h 2 }] 2 ) ^xMogfe in xheorems 5.2 and 5.3, respectively. Clearly these 
bounds are better when g or h grow moderately fast with n. We suspect that the O(-) part of each 
bound can be replaced by a universal constant. The resulting bounds would be tight in the case 
of genus, and almost tight in the case of .fQj-minor-free graphs. It is not clear whether the log h 
factor is necessary in general. 
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5.2 Balanced vertex separators 

For a graph G = (V,E), a vertex separator is a partition V = AU B U S where E(A, B) = 0. We 

I CI 

define a(A,B,S) = \ aus\-\bus\ ' an< ^ = mina(-A, B, 5), where the minimum is taken over all 

vertex separators. We recall the following lemma from [17, §3]. 

Lemma 5.4 ([17]). If s : V E + and d s is the induced metric, then for any non-expansive map 
f : (V,d s ) — > E, there exists a separator (A,B,S) (found by performing a sweep with f), such that 

a(A,B,S)< 2 ^eV s ( v ) 



Eu,« e vl/(«) -/(«)!" 

Theorem 5.5. If G = (V,E) is a genus g graph, then a(G) = 0{n- 3 / 2 g 3 / 2 ). If G = (V, E) 
is Kh-minor free, then a(G) = 0(n~ 3 / 2 h 3 y/log h) . Therefore such graphs have 0(g 3 ^ 2 \/n) and 
0(h 3 i/iogh,/n)- sized (|, ^-balanced separators, respectively. 

Proof. We prove the theorem only for a K^-minor free graph G. 

J2vev s ( v ) . i ■ VJ2vev s ( v ) 2 V™ ( h^logh 

< ■ mm = = U ' 



mm 



s-.V^R+ J2 u ,vev ds(u,v) v ' s-.v^R+ Y, u ,veV d *( u i v ) max s: y- + R + A S (G) V n 3 l 2 

by Theorems 2.2 and 3.11. 

Let s : V — ► be the minimizer of the left-hand side, and apply Theorem 4.4 to (1/, c2 s ) with 
p = 1. Since a(V,d s ) = 0(h 2 ) by Corollary 4.2, this yields a non-expansive map / : (V,d s ) — > E 
with 

E«, w6 vl/(«)-/(«)|- 1 ; E„ >B6 v^(«,«) V n 3 / 2 

We apply Lemma 5.4 to achieve a(G) = 0(n^ 3 / 2 h 3 ^\og h). Finally, we note that the passage 
from this bound on ct(G) to balanced separators of size 0(h 3 \/\og hy/n) uses a standard recursive 
quotient cut algorithm; see e.g. [17, §6]. □ 



5.3 Geometric graphs 

In practice, spectral methods are applied to graphs arising from a variety of geometric settings, not 
limited to surfaces of fixed genus. Miller et al. considered /c-ply neighborhood systems, /c-nearest 
neighbor graphs, and well-shaped finite element meshes in any fixed dimension [35, 36]. They used 
geometric techniques to efficiently find small ratio cuts for these classes of graphs. Spielman and 
Teng give bounds for the second eigenvalue of these graphs, thus showing that these cuts can be 
recovered by spectral partitioning [47]. 

While none of these graph families exclude a fixed set of minors, some of them have been shown 
to lack small minors at small depth. We can adapt the proofs from the preceding subsections to 
this setting using the following lemma. 

Lemma 5.6. Let G = (V 7 , E) have constant maximum degree and exclude a K^-minor at depth L, 
where h = L p for some constant p and \ V\ = n. We have, 

• A 2 (G) = 0(n- 1 /(i+f)). 
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l 1 I 

G has a vertex separator (A, B, S) satisfying a(A, B, S) = 0{n 2 + 2 p). It also has (l/3,2/3)-| 



balanced separators of size 0{n l 2 + 2 p). 

Proof. For any weight function s: V — > R+, we have a(V,d s ) = O(l) by Theorem 4.3. By Theo- 
rems 2.2 and 3.12, we have 



max AJG) = mincon 2 (F) > min ( — ^ ,n 3/2 L] = tt (n 2 + 2 + 2 A 



where the last equality follows by setting L = n 1 ^ 2+2p \ and the O(-) and fj(-) notations hide 
poly(logn) factors. The eigenvalue bound follows immediately from an application of Theorem 5.1. 
As in the proof of Theorem 5.5, we have 



mm 



S{V) < ^ = 0fn- 1 -^V 

s:V^M+^2 UjVeV d 8 {u,v) max s: V ^ R+ A S (G) V > 

This gives us a non-expansive map /: (V,d s ) — ► R with 



Eu,wevl/( u )-/( u )l Y. u ,vev d M,v) ' V / 

An application of Lemma 5.4 establishes the bound on a(A, B, S), and recursive quotient cuts can 
be used to find the corresponding balanced separators. □ 

Theorem 5.7. Let G = (V, E) be a graph with n vertices and constant maximum degree. 

• If G is a simplicial graph in d dimensions with constant aspect ratio (see [37] for a detailed 
definition), then A 2 (G) = 0(n _1 / d ) and G has balanced separators of size din 1 -™). 

• If G is an arbitrary k-nearest neighbor graph in d dimensions, then A 2 (G) = 0(n _1 /( 1+d )) 
and G has balanced separators of size 0{n 2+2d). 



• If G is a d-dimensional grid, then \2{G) = 0{n 2 /( 2+d )) and G has balanced separators of 
size 0(n 2 + d ). This is also true with high probability when G is the relative neighborhood 
graph, the Delaunay diagram, or the k-nearest neighbor graph of a random point set in d 
dimensions. 

Proof. The results follow from the corresponding bounds on excluded shallow minors. From Plotkin 
et al. [39], we have h = Sld{L d ~ l ) for simplicial graphs and h = £l ( i{L d l 2 ) for grids. From Teng [48], 
we have h = 0,(L d ) for arbitrary ^-nearest neighbor graphs and, with high probability, h = Q,{L d / 2 ) 
for the relative neighborhood graph, the Delaunay diagram, and the fc-nearest neighbor graph of a 
random point set. □ 

Remark 5.2. Spielman and Teng [47] prove that fe-nearest-neighbor graphs and well-shaped meshes 
have A 2 of value 0(n~ 2 l d ) and balanced separators of ratio 0(n~ l l d ). Their results are better than 
ours by a square; we suspect this is due to the non-tightness of the bounds on shallow excluded 
minors for these graph families. 
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